Detection of non-constant long memory parameter^ 



(N 

O 
(N 

00 



H 

00 



> 
oo 
cn 

in 
d 



Frederic Lavancier^ (frederic.lavancier@univ-nantes.fr, 
Remigijus Leipus^'^ (remigijus.leipus@mif.vu.lt), 
Anne Philippe^ (anne.pliilippe@univ-nantes.fr), 
Donatas Surgailis^'^ (donatas.surgailis@mii.vu.lt) 



^ Laboratoire de Mathematiques Jean Leray, Universite de Nantes, France, 
'^Faculty of Mathematics and Informatics, Vilnius University, Lithuania, 
^Institute of Mathematics and Informatics, Vilnius University, Lithuania 



Abstract This article deals with detection of nonconstant long memory parameter in time series. 
The null hypothesis presumes stationary or nonstationary time series with constant long memory 
parameter, typically an I{d) series with d > —.5. The alternative corresponds to an increase in 
persistence and includes in particular an abrupt or gradual change from I{di) to I{d2), —.5 < di < d2- 
We discuss several test statistics based on the ratio of forward and backward sample variances of the 
partial sums. The consistency of the tests is proved under a very general setting. We also study 
the behavior of these test statistics for some models with changing memory parameter. A simulation 
study shows that our testing procedures have good finite sample properties and turn out to be more 
powerful than the KPSS-based tests considered in some previous works. 
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1 Introduction 

The present paper discusses statistical tests for detection of non-constant memory parameter of time 
series versus the null hypothesis that this parameter has not changed over time. As a particular 
case, our framework includes testing the null hypothesis that the observed series is I{d) with constant 
d > —.5, against the alternative hypothesis that d has changed, together with a rigorous formulation 
of the last change. This kind of testing procedure is the basis to study the dynamics of persistence. 



which is a major question in economy (see Kumar and Okimoto (2007), Hassler and Nautz (2008), 



Kruse (2008)). 



In a parametric setting and for stationary series {\d\ < .5), the problem of testing for a single change 
of d was first investigated by Beran and Terrin (1996), Horvath and Shao ( 1999| ), Horvath (2001), 



Yamaguchi ( 2011 ) (see also Lavielle and Ludeha (2000), Kokoszka and Leipus ( 2003 )). Typically, the 
sample is partitioned into two parts and d is estimated on each part. The test statistic is obtained by 
maximizing the difference of these estimates over all such partitions. A similar approach for detecting 
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multiple changes of d was used in Shimotsu ( 2006 ) and Bardet and Kammoun ( 2008 ) in a more general 
semiparametric context. 

The above approach for testing against changes of d appears rather natural although applies to 
abrupt changes only and involves (multiple) estimation of d which is not very accurate if the number 
of observations between two change-points is not large enough; moreover, estimates of d involve band- 
width or some other tuning parameters and are rather sensitive to the short memory spectrum of the 
process. 

On the other hand, some regression-based Lagrange Multiplier procedures have been recently dis- 



cussed in Hassler and Meller (2009) and Martins and Rodrigues (2010). The series is first filtered by 



(1 — L)'^, where L is the lag operator and d is the long memory parameter under the null hypothesis, 
then the resulting series is subjected to a (augmented) Lagrange Multiplier test for fractional inte- 
gration, following the pioneer works by Robinson ( |1991 1994). The filtering step can be done only 
approximatively and involves in practice an estimation of d. This is certainly the main reason for the 



size distortion that can be noticed in the simulation study displayed in Martins and Rodrigues (2010). 



In a nonparametric set up, following Kim (2000), Kim et al. (2002) proposed several tests (hereafter 



referred to as Kim's tests), based on the ratio 

^n(T) 



U* 

n— [nrj 



where 



K-kix) ■■- 



r G [0,1], 



(s* 



are estimates of the second moment of forward and backward de-meaned partial sums 



n~k n-k) 



(1.1) 



(1.2) 
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I, i = 1, . . . 
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k 



s: 



n—k 1 1 



j = k + l,...,n, 



on intervals [1,2,...,A;] and [k + l,...,n], respectively. Here and below, given a sample X 
{Xi, . . . , Xn), 

k n 
^k '■= ^"^Xj, S^-k '■- 

denote the forward and backward partial sums processes. Originally developed to test for a change 



E 

j=k+i 



Xi 



from /(O) to /(I) (see also 


Busetti and Taylor 


in Hassler and Scheithauer 


(2011 


) to detect 



different approach based on the so-called CUSUM statistics, was used in Leybourne et al. (2007) 



and [Sibbertsen and Kruse (2009) to test for a change from stationarity {di < .5) to nonstationarity 
{d2 > .5), or vice versa. 

The present work extends Kim's approach to detect an abrupt or gradual change from I{di) to 
I{d2), for any —.5 < di < d2 with exception of values di,d2 £ {.5,1.5,...} (see Remark 3.2 for 
an explanation of the last restriction). This includes both stationary and nonstationary null (no- 
change) hypothesis which is important for applications since nonstationary time series with d > .5 



are common in economics. Although our asymptotic results (Propositions 3.1, 4.1 and Corollary 3.1) 



are valid for the original Kim's statistics, see Remark 4.3, we modify Kim's ratio (1.1), by replacing 
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the second sample moments Uk{X), U*_i^{X) in (1.2) of backward and forward partial smns by the 
corresponding empirical variances Vk{X), V*_i^{X) defined at (3.1) below. This modification is similar 
to the difference between the KPSS and the V/S tests, see Giraitis et al. (2003), and leads to a more 
powerful testing procedure (see Tables [lj|2]) . It is important to note that the ratio-based statistics 
discussed in our paper, as well as the original Kim's statistics, do not require an estimate of d and do 
not depend on any tuning parameter apart from the choice of the testing interval T C (0, 1). However, 
the limiting law under the null hypothesis depends on d, hence the computation of the quantile defining 
the critical region requires a weakly consistent estimate of the memory parameter d. 

The paper is organized as follows. Section [2] contains formulations of the null and alternative hy- 
potheses, in terms of joint convergence of forward and backward partial sums processes, and describes 
a class of I{d) processes which satisfy the null hypothesis. Section [3] introduces the ratio statistics 
Wn,In and Rn and derives their limit distribution under the null hypothesis. Section |4] displays the- 
oretical results, from which the consistency of our testing procedures is derived. Section [5] discusses 
the behavior of our statistics under alternative hypothesis. Some fractionally integrated models with 
constant or changing memory parameter are considered and the behavior of the above statistics for 
such models is studied. Section [6] extends the tests of Section [3] to the case when observations contain 
a linear trend. Section [7] contains simulations of empirical size and power of our testing procedures. 
All proofs are collected in Section [Sl 



2 The null and alternative hypotheses 

Let X = {Xi, . . . , Xn) be a sample from a time series {Xj} = {Xj,j = 1,2,...}. Additional assump- 
tions about {Xj} will be specified later. Recall the definition of forward and backward partial sums 
processes of X: 

k n 

Sk = Sk{X) = '^Xj, = = ^ Xj. 

j=i j=k+i 

Note that backward sums can be expressed via forward sums, and vice versa: 5'*_^ = Sn — Sk, 

Jk — Jn >^n-k- 

For < a < 6 < 1, let us denote by D[a, h] the Skorokhod space of all cadlag (i.e. right-continuous 
with left limits) real- valued functions defined on interval [a, h]. In this article, the space D[a, b] and the 
product space D[ai, bi] x D[a2, 62], for any < aj < 6j < 1, i = 1, 2, are all endowed with the uniform 
topology and the ci-field generated by the open balls (see |Ponard| ( |1984D ). The weak convergence 



of random elements in such spaces is denoted ' — >D[a,b] and ' — > D[ai,bi]xD[a2,b2] respectively; the 
weak convergence of finite-dimensional distributions is denoted ' — >fdd] the convergence in law and 
in probability of random variables are denoted ' — >-iaw' and ' — >p\ respectively. 

The following hypotheses are clear particular cases of our more general hypotheses Hq, Hi specified 
later. The null hypothesis below involves the classical type I fractional Brownian motion in the limit 
behavior of the partial sums, which is typical for linear models with long memory. Recall that a type 
I fractional Brownian motion ^^_|_ 5 = ^{t).,t > 0} with Hurst parameter H = d + .5 € (0,2), 
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i7 / 1 is defined by 



Tiki) /-oo ((^ - - {-n)i)dB{u), -.5<d< .5, 
B'^_^,{u)du, .5<d<1.5, 



(2.1) 



where (— u)+ := (— u) V and {B{u),u G M} is a standard Brownian motion with zero mean and 
variance Ei?-^(u) = Let [xj denote the integer part of the real number a; G M. 



Ho[I]: There exist d S (—.5, 1.5), d 7^ .5, k > and a normaUzation An such that 



(2.2) 



Hi [I]: There exist < vo < vi < 1, d > —.5, and a normaUzation An such that 

(n-^-'^iS^nr,] - [nrilAn], n-^-'^iSl^^^^ - [nT2\An)) -^dio,v,]xDIo,i-vo] (0,^2(r2)), (2.3) 

as n — )• 00, where {Z2{t),t £ [1 — wi, 1 — vq]} is a nondegenerate a.s. continuous Gaussian process. 

Here and hereafter, a random element Z of D[a, b] is called nondegenerate if it is not identically zero 
on the interval [a, b] with positive probability, in other words, if P(Z(n) = 0, Vu G [a, b]) = 0. 



Typically, the null hypothesis Ho[I] is satisfied by I{d) series (see Definition 5.1). In Section 5.1 



we give a general family of linear processes satisfying Ho[I] including stationary and nonstationary 
processes. See also |Taqqu| ( |1979D , [Giraitis et ah] ( |2000[ ) and the review paper iGiraitis et al. (|2009|) 
for some classes of non-linear stationary processes (subordinated Gaussian processes and stochastic 
volatility models) which satisfy Ho[I] for < d < .5. The alternative hypothesis corresponds to the 



processes changing from I{di) to 1(^2) processes (see Section 5.3 for examples). 
Let us give a first example based on the well-known FARIMA model. 

Example 2.1 A FARIMA(0, d, 0) process et{d) = Zl^o ^«(^)Ct-s with -.5 < d < .5 satisfies as- 
sumption Ho[I] with K = 1, An = 0. Here, ■7Ts{d),s = 0,1,... are the moving- average coefficients 



(see (5.12)) and {Q} is a Gaussian white noise with zero mean and unit variance. Moreover, for two 
different memory parameters —.5<di<d2< .5, we can construct a process satisfying Hi [I] by 



et{di), t<[ne*\, 
et{d2), t>[ne*\, 



(2.4) 



where 0* G (0,1). The process in ( |2.4[ ) satisfies ( |2.3[ ) with d = d2, An = 0, vq = 0, vi = 9*, and 
Z2{t) = 5^+ 5(1) - B\^ ^{e* V (1 - r)), r G [0, 1]. In the case of .5 < d < 1.5, FARIMA(0,d,0) process 



in (2.4) is defined by et{d) = X;*=i where {Yt} is a stationary FARIMA(0,d - 1,0). 



The testing procedures of Section [s] for testing the hypotheses Ho[I] and Hi [I] can be extended to 
more general context. We formulate these 'extended' hypotheses as follows. 



Hq: There exist normalizations 7„ — t- 00 and An such that 



(2.5) 
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where {Z{t),t £ [0, 1]} is a nondegenerate a.s. continuous random process. 



Hi: There exist < vq < vi < 1 and normahzations 7„ — )• oo and such that 

[nrij ['^''"iJ^")' ('^[nr2j [^''"sj^n)) ^ D[0,vi]xD[0,l—vo] (Oi -^2 ("^2)) j (^-S) 

where {Z2{t),t £ [1 — fi, 1 — vq]} is a nondegenerate a.s. continuous random process. 

Typicahy, normahzation An = EXq accounts for centering of observations and does not depend on 
n. Assumptions Hq and Hi represent very general forms of the nuh ('no change in persistence of X') 
and the alternative ('an increase in persistence of X') hypotheses. Indeed, an increase in persistence 
of X at time fc* = [nvi\ typically means that forward partial sums Sj,j < grow at a slower rate 
7ni compared with the rate of growth 7^2 of backward sums S*,j < n — k.^. Therefore, the former 
sums tend to a degenerated process Zi(t) = 0, t € [0,^1] under the normalization 7„ = 7^2 • Clearly, 
Hq and Hi are not limited to stationary processes and allow infinite variance processes as well. While 
these assumptions are sufficient for derivation of the asymptotic distribution and consistency of our 
tests, they need to be specified in order to be practically implemented. The hypothesis Ho[I] presented 
before is one example of such specification and involves the type I fBm. Another example involving 



the type II fBm is presented in Section 5.2 



3 The testing procedure 
3.1 The test statistics 



Analogously to (1.1)-(1.2), introduce the corresponding partial sums' variance estimates 

k 



Vk{X) 

v:.u{x) 



1 



i=i 
1 



1 



(n — k)'- 



■ E 

j=k+i 

1 



+1 



n-j + l n2 
n-k "-^ 



(3.1) 



(n - fc)3/2 



sr^ fa* _ n-j + 1 



j=k+l 

and the corresponding 'backward/forward variance ratio': 

v: ,jx) 



n — k 



n— [nrj ' 



TG [0,1]. 



(3.2) 



For a given testing interval T = [z^t] C (0,1), define the analogs of the 'supremum' and 'integral' 



statistics of Kim (2000): 



Wn{X) := sup£„(r), UX) := / £„(r)d7 



We also define the analog of the ratio statistic introduced in Sibbertsen and Kruse (2009): 

- inf.,rnn.j(^) ■ 



(3.3) 



(3.4) 
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This statistic has also the same form as statistic R of Leybourne et aL (2007), formed as a ratio of 
the minimized CUSUMs of squared residuals obtained from the backward and forward subsamples of 



X, in the /(0)//(l) framework. The limit distribution of these statistics is given in Proposition 3.1 
To this end, define 

Z*{u) := Z(l) - Z(l --u), u G [0,1] (3.5) 



and a continuous time analog of the partial sums' variance V|^„^j(X) in (3.1): 

^ ^ ^"(Z(n)-^Z(r))'di.-i( r(Z(n)-^Z(r))dn)' 



Qr{Z) :-- 



(3.6) 



Note Qi-riZ*) is the corresponding analog of V^^_|^„^j(^) in the numerators of the statistics in (3.2) 
and dO). 



Proposition 3.1 Assume Hq. Then 

[in^iSlnr^l " [nTi\An), TnH'S'LnraJ " [nT2\An)^ ^D[0,1] X D[0,1] {Z {n) , Z* {T2)) . 

Moreover, assume that 

Qt{Z) > a.s. for any t £ T- 

Then 

Qi-Az*) 



(3.7) 
(3.8) 



Wn{X) 
In{X) 
Rn{X) 



^law W{Z) := sup 

*-law HZ) 

Ha.w R{Z) : 



T&T Qt{Z) 
Ql-rjZ 
rer Qr{Z) 

ini-rer Qi-r{Z* 
mirerQriZ) 



dr, 



(3.9) 



The convergence in (3.7) is an immediate consequence of Hq, while the fact that (3.7) and (3.8) 
imply (3.9) is a consequence of Proposition 4.1 stated in Section |4j 

Remark 3.1 As noted previously, the alternative hypothesis Hi focuses on an increase of d, and the 
statistics (3.3), (3.4) are defined accordingly. It is straightforward to modify our testing procedures 
to test for a decrease of persistence. In such case, the corresponding test statistics are defined by 
exchanging forward and backward partial sums, or V|^„^j(X) and V*_^^^^{X): 

inf^er V[nT\ (X) 



W*{X) := supC-Hr), Il{X) := [ C-\T)dT, R*^{X) 



(3.10) 



mf.er^:_L„.j(^)' 

In the case when the direction of the change of d is unknown, one can use various combinations of 
(3.3) and (3.10), e.g. the sums 

W:iX) + Wn{X), i:{X)+In{X), Rl{X) + Rn{X), 

or the maxima 

max{Ty*(X),VF„(X)}, max{/:(X), /„(X)}, max{i?;(X), i?„(X)}. 
The limit distributions of the above six statistics under Hp follow immediately from Proposition |3.1[ 



However, for a given direction of change, the 'one-sided' tests in (3.3), (3.4) or (3.10) are preferable 
as they are more powerful. 
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3.2 Practical implementation for testing Ho[I] against Hi [I] 

Under the 'type I fBm null hypothesis' Ho[I], the limit distribution of the above statistics follows 



from Proposition 3.1 with 7„ = n'^^'^ and Z = kB^_^_ g. In this case, condition (3.8) is verified and we 



obtain the following result. 
Corollary 3.1 Assume iio[I\. Then 

Wn{X) ^law W{B\^,,), In{X) ^law /(i^^+.g), Rn{X) ^law R{B\+.,) 



(3.11) 



The process 5 in (3.11) depends on unknown memory parameter d, and so do the upper 

(3.12) 



a— quantiles of the r.v.'s in the right-hand sides of (3.11) 

(§{a,d) := inf{x : Y>{T{B\^r,) <x)>l-a)] 



where T = W,I,R. Hence, applying the corresponding test, the unknown parameter d in (3.12) is 
replaced by a consistent estimator d. 
Testing procedure. Reject Ho[I], if 



WniX) > gU(a,d), IniX) > qf\a,d), Rn{X) > (?™(a,d), 
respectively, where d is a weakly consistent estimator of d: 

d — >p d, n — )• 00. 



(3.13) 



(3.14) 



The fact that the replacement of d by d in (3.13) preserves asymptotic significance level a is guar- 



anteed by the continuity of the quantile functions provided by Proposition 3.2 below 



Proposition 3.2 Let d G (—.5, 1.5), d ^ .5, a £ (0, 1) and let d satisfy (3.14-)- Then 



(§{aj) Qf'(a,d), for T = W, I, R. 

We omit the proof of the above proposition since it follows the same lines as in the paper Giraitis 



et al. (2006, Lemma 2.1) devoted to tests of stationarity based on the V/S statistic. 



Several estimators of d can be used in (3.13). See the review paper Bardet et al. (2003) for a 



discussion of some popular estimators. In our simulations we use the Non- Stationarity Extended 
Local Whittle Estimator (NELWE) of Abadir et al. (2007), which applies to both stationary {\d\ < .5) 
and nonstationary (d > .5) cases. 

Remark 3.2 The above tests can be straightforwardly extended to d > 1.5, d / 2.5, 3.5, . . . , provided 
some modifications. Note that type I fBm for such values of d is defined by iterating the integral in 
(2.1) (see e.g. Davidson and de Jong ( 2000| )). On the other hand, although type I fBm can be defined 
for d = .5, 1.5, ... as well, these values are excluded from our discussion for the following reasons. 
Firstly, in such case the normalization 7^ of partial sums process of 1(d) processes is different from 
^d+.5 g^y^^ contains an additional logarithmic factor, see Liu (1998). Secondly and more importantly. 



for d = .5 the limit process Z[t) = B\{t) = tB\{1) is a random line, in which case the limit statistic 



Qr{Z) in (3.6) degenerates to zero, see also Remark 4.2 below. 
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4 Consistency and asymptotic power 



It is natural to expect that under alternative hypotheses Hi or Hi [I] , all three statistics Wn{X), 
Rn{X) tend to infinity in probability, provided the testing interval T and the degeneracy interval [0, vi\ 



of forward partial sums are embedded: T C [0, f i]. This is true indeed, see Proposition 4.1 (iii) below. 



meaning that our tests are consistent. Moreover, it is of interest to determine the rate at which these 



statistics grow under alternative, or the asymptotic power. The following Proposition 4.1 provides the 
theoretical background to study the consistency of the tests. It also provides the limit distributions 



of the test statistics under Hq since Proposition 3.1 is an easy corollary of Proposition 4.1 (ii). 



Proposition 4.1 (i) Let there exist < fo < fi < 1 and normalizations 'jni — )• oo and Ani, i 
such that 



1,2 



nT2\ 



[nT2\A. 



n2 



^D[Q,vi\xD[0,l-vo\ 



(^i(ri),Z2(T2)),(4.1) 



where (Zi(ri), Z2(r2)) is a two-dimensional random process having a.s. continuous trajectories on 
[vo,vi\ X [1 — vi^l — vq\. Then 

{QrAZl),Ql-r,{Z2)). (4.2) 



Moreover, the limit process ((5t-i(-Z^i)7 Qi-r2(-^2)) in- {4-'^) is ^-S- continuous on {vo,vi] x [vq,vi). 



(ii) Assume, in addition to (i), that T CU := [vo,vi] and 

Qr{Zi) > a.s. for any t £ T. 



(4.3) 



Then, as n ^ oo. 



{lnlhn2fWn{X) 
{lnlhn2?In{X) 
{lnlhn2fRn{X) 



haw sup 



Ql-r{Z2) 



^law 



'law 



rer Qt{Zi) 

Ql-r{Z2) 

er Qt{Zi) 

inf^gr Ql-r(-^2) 
m.ir(irQr{Zl) 



dr, 



(4.4) 



(iii) Assume, in addition to (i), that T CU, Zi{t) = 0, t G T and the process {Qi-r{Z2),T G T} is 
nondegenerate. Then 



{lnlhn2f < 



Wn{X) 
In{X) 
I Rn{X) 



OO. 



(4.5) 



Remark 4.1 Typically, under Hi relation (4.1) is satisfied with 7„2 increasing much faster than 7„i 
(e.g., 7„i = n'^'+-^, i = 1,2, di < ^2) and then (4.4) imply that Wn{X), In{X) and Rn{X) grow as 



Op((7n2/7ni)^) • Two classcs of fractionally integrated series with changing memory parameter and 
satisfying ( |4.1[ ) are discussed in Section [s} 
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Remark 4.2 Note that Qt-{Z) > by the Cauchy-Schwarz inequahty and that Qr{Z) = imphes 
Z{u) — ^Z{t) = a for ah u G [0,r] and some (random) a = a^r). In other words, F{Qt{Z) = 0) > 
imphes that for some (possibly, random) constants a and b, 



P(Z(n) = a + -6, Vu G [0,r]) > 0. 



(4.6) 



Therefore, condition (4.3) imphcitly excludes situations as in (4.6), with a 7^ 0, 6 7^ 0, which may arise 



under the null hypothesis Hq, if An = in (|2.5l) whereas the -^j's have nonzero mean 



Remark 4.3 All the results in Sections [s] and [s] hold for Kim's statistics in (7.1 ), defined by replacing 



yLnrj(^),^;_Lnrj(^) m (Q, (Q by C/l„,j (X ),[/*_ (X) as given in (Q, with the only differ- 
ence that the functional Qr{Z) in the corresponding statements must be replaced by its counterpart 



Qr{Z) := {Z{u) - '^Z{T)ydu, cf. (3.6). 



5 Application to fractionally integrated processes 

This section discusses the convergence of forward and backward partial sums for some fractionally inte- 
grated models with constant or chang ing memory parameter and the behavior of statistics T4^^, I^i^ R^, 
for such models. 

5.1 Type I fractional Brownian motion and the null hypothesis Ho[I] 

It is well-known that type I fBm arises in the scaling limit of d— integrated, or /(d), series with i.i.d. 



or martingale difference innovations. See Davydov (1970), Peligrad and Utev (1997), Marinucci and 



Robinson (1999), Bruzaite and Vaiciulis (2005) and the references therein. 



A formal definition of I{d) process (denoted {Xt} ~ I{d)) for d > —.5, d / .5,1.5,... is given 
below. Let MD(0, 1) be the class of all stationary ergodic martingale differences {Q, s G with unit 



variance E[C^] = 1 and zero conditional expectation E[(^s|J^5_ 
nondecreasing family of o"— fields. 

Definition 5.1 (i) Write {Xt} ~ /(O) if 

00 

j=0 



0, s G Z, where G Z} is a 



(5.1) 



is a moving average with martingale difference innovations {(j} G MD(0, 1) and summahle coefficients 
(a) Let d G (—.5, .5)\{0}. Write {Xt} ~ I{d) if {Xt} is a fractionally integrated process 



Xt = {l- L)-''Yt = Md)Yt-j, t G 



(5.2) 



where Yt = Xl^o '^jCt-j, {Yt} ~ I{0) and {TTj(d),j > 0} are the coefficients of the binomial expansion 

(Hi) Let d > .5 and d ^ 1.5, 2.5,.... Write {Xt} ~ I{d) if Xt = E5=i^i> ^ = 1,2,..., where 
{Yt}^I{d-l). 
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In the above definition, {Xt} ~ I{d) for d > .5 is recursively defined for t = 1,2,... only, as a 
p— times integrated stationary I{d — p) process, where p = [d + .5j is the integer part of d + .5, and 
therefore {Xt} has stationary increments of order p. A related definition of 1(d) process involving 
initial values X-i,i = 0, 1, . . . is given in (5.8) below. From Definition 5.1 it also follows that an I{d) 
process can be written as a weighted sum of martingale differences {Cs} G MD(0, 1), for instance: 



Xt 



-.5 < d < .5, 
.5 < d < 1.5, 



t = 1,2, 



Es<t(«*^(^))t-«Cs, 

where (a*7r(d))j := X]i=o J ^ is the convolution of the sequences {aj} and {iTj{d)}. 



(5.3) 



Proposition 5.1 (i) Let {Xt} ~ I{d) for some d £ (—.5,1.5), d ^ .5. If d £ (—.5,0], assume in 
addition E|Ci|p < oo, for some p > l/(.5 + d). Then (2.2) holds with An = 0, n = X]£o^*- 
(ii) Let {(Js,s G Z} be an almost periodic sequence such that cr^ 



lim^ 



n 



Let 



{Xt} be defined as in [5^, where (s, s £ Tj are replaced by cTsCs, s £ Ij and where d and {Cs} satisfy 



the conditions in (i). Then (2.2) holds with An = 0, k = o" 



The proof of Proposition 
delta-function. Indeed, 



5.1 



can be easily reduced to the case aj = kSj, where 6j = l(j = 0) is the 



e( J](X,-Xt)) =oK+i) 



(5.4) 



where Xj 



k(1 



-.5 < d < .5) and x] 



^Ei=ii^ - L)-^''-'kk {.5 <d< 1.5) 



IS 



(integrated) FARIMA(0, d, 0) process. The proof of the approximation (5.4) is given in Section^ The 



proof of Proposition 5.1 is omitted in view of (5.4) and since similar results under slightly different 



hypotheses on the innovations {^s} can be found in Bruzaite and Vaiciulis (2005), Chan and Terrin 
(1995), Davidson and de Jong ( 2000[ ), Giraitis et al. (2012), and elsewhere. In particular, the proof 



of the tightness in D[0, 1] given in Giraitis et al. (2012, Proposition 4.4.4) carries over to martingale 



difference innovations, see also Bruzaite and Vaiciulis (2005, Theorem 1.2), while part (ii) follows 



similarly to Bruzaite and Vaiciulis (2005 Theorem 1.1), using the fact that the sequence {asCs} 
satisfies the martingale central limit theorem: n^^^'^Yli^i (^sCs — >fdd &B{t). Note that the linear 
process {Xt} in Proposition |5.1| (ii) with heteroscedastic noise {cr^Cs} is nonstationary even if \d\ < .5. 



5.2 Type II fractional Brownian motion and the null hypothesis Ho[II] 
Definition 5.2 A type II fractional Brownian motion with parameter d > —.5 is defined by 



rid+l)Jo ^ 



T - u)'^dB(u) 



r > 0, 



(5.5) 



where {B{u),u > 0} is a standard Brownian motion with zero mean and variance Ei?^(n) = u. 



A type II fBm shares many properties of type I fBm except that it has nonstationary increments, 
however, for \d\ < .5 increments at time r of type II fBm tend to those of type I fBm when r — )• oo. 



Davidson and Hashimzade ( 2009 ) discussed distinctions between the distributions of type I and type 



II £Bms. Convergence to type II fBm of partial sums of fractionally integrated processes was studied 
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in 


Marinucci and Robinson 


1999) 


(2000 


), 


Leipus and Surgailis 


(2010 



Type II fBm may serve as the limit process in the following specification of the null hypothesis Hq. 
Ho [II]: There exist d > —.5, k > and a normalization An such that 

n-''-''{S^nr\-lnr\An) -^om ^^d+.sW- (5-6) 



The alternative hypothesis to Ho[II] can be again Hi [I] of Section [2] 



Proposition 5.1 can be extended to type II fBm convergence in ( |5.6[ ) as follows. Introduce a 'trun- 

(5.7) 



cated' /(O) process 



Ylj=o ^jCt-j, t — 1,2, 



0, 



t = 0,-1,-2, ... 



where {aj} and {(^s} are the same as in (5.1). Following Johansen and Nielsen (2010), for d > 
consider a d— integrated process {Xt,t = 1,2,...} with given initial values = 0,1,...} as 

defined by 



(5.8) 



(1 - L)-% + (1 - L)-^{1 - L)txl t = l,2,..., 

where {Yj} is defined in (5.7) and the operators (1 — L)^ are defined through corresponding 'truncated' 
binomial expansions: 



t-i 



(l-iy^Zt := Y,^,{-d)UZt, {l-L)tZt := 7r,(-d)L^Zt = 7rt+,(-d)L%, 
j=0 j=t 



1=0 



t = 1,2, . . . . Note that the term (1 - L):^^{1 - L)iX]^ in (5.8) depends on initial values {X^-,i = 
0, 1, . . . } only. The choice of zero initial values X^^ = 0, i = 0, 1, . . . in (5.8) leads to type II process 
Xt = {1 — L)^^Yt, more explicitly. 



Xt = ^{a-kTr{d))t-sCs- 



(5.9) 



s=l 



In general, {-'^'^j} can be deterministic or random variables satisfying mild boundedness conditions 
for the convergence of the series (1 — L)'^X^. 



Proposition 5.2 (i) Let {Xt} he defined in (5.8), with {Yt} as in (5.1) and initial values {X^^} 
satisfying for d > .5 

supE(X°j2 < oo. (5.10) 

j>0 

For —.5 < d < .5 assume that X^- = 0. If d £ (—.5,0], assume in addition E|Ci|p < oo, for some 



p > l/(.5 + d). Then (5.6) holds with A„ = 0, k = X^^g 

(ii) Let {(Ts,s > 1} be an almost periodic sequence such that a"^ := lim^^oo ^^^^ ^"=1 > 0. Let 



{Xt} be defined as in (5.9), where Csi -s > 1 are replaced by CsCs, s > 1 and where d and {Qs} satisfy 



the conditions in (i). Then (5.6) holds with An = 0, k = o'^^o^*- 
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Remark 5.1 For d > .5, Proposition 5.2 (i) implies that any L^— bounded initial values have no effect 



on the limit distribution of partial sums of the process in ( 5.8 ) . As it follows from the proof in Section|8| 
below, the above statement also remains valid for arbitrary initial values {-'^^^j} possibly depending 
on n and growing at a rate Op{n^^'^) with some < A < 1 A {2d — 1), viz., supj>Q E(X^^ < Cn^, 
d>0. 



Similarly to Corollary 3.1, Proposition |3.1| implies the following corollary. 
Corollary 5.1 Let {Xt} satisfy the conditions of Proposition \57^ Then 

where {B^^ 5(''")i ^ [0' 1]} ^ ^VP^ II fBm as defined in (5.5). 



Remark 5.2 Numerical experiments confirm that the upper quantiles q^\a, d), T = W,I, R, of the 
limit r.v.s on the r.h.s. of (5.11) are very close to the corresponding upper quantiles q^{a,d) of the 
limiting statistics in (3.11) when d is smaller than 1 (see Figure [T] in the particular case T = I). In 
other words, from a practical point of view, there is not much difference between type I fBM and type 
II fBm null hypotheses Hq [I] and Hq [II] in testing for a change of d when d <1. 





















*- 




*** 

**** 



3.5 



2.5 



0.5 



0.5 



1.5 



Figure 1: Representation of the ratio ^^'(0.05, d)/q^^\Q.Qb, d) as function of d, with the choice r = 0.1 
and r = 0.9. 



5.3 Fractionally integrated models with changing memory parameter 

Let us discuss two nonparametric classes of nonstationary time series with time- varying long memory 
parameter termed 'rapidly changing memory' and 'gradually changing memory'. 

Rapidly changing memory. This class is obtained by replacing parameter d by a function d{t/n) G 
[0, oo) in the FARIMA(0, d, 0) filter 

vrj(d) = ^ = Jy^^ J = 1,2,..., 7ro(d):=l. (5.12) 
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Let d{T), T G [0, 1] be a function taking values in the interval [0, oo). (More precise conditions on the 
function d(r) will be specified below.) Define 



:= nj{d{^)), j = 0,l,..., 
t 

Xi,t ■■= ^6i,t-s(t)G, t = l,...,n, 



(5.13) 



where the innovations ^s, s > 1 satisfy the conditions of Definition 5.1 The particular case 

d(r) = <^ (5.14) 
[l, T€{9*,1] 

for some < 6* < 1, leads to the model 

C,. t=l.2 I^nl. 

(5.15) 



X 



i,t 



ZUiCs, t=[e*n\ + i,.. 



which corresponds to transition 1(0) — )■ 1(1) at time [0*nj + 1. A more general step function 



dir) 



di, TG[0,e*], 
d2, rG{9\l] 



(5.16) 



corresponds to {-'^i,*} changing from I{di) to I{d2) at time [6*n\ + 1. 

Gradually changing memory. This class of nonstationary time- varying fractionally integrated processes 
was defined in Philippe et al. ( 2006a|b 2008). Here, we use a truncated modification of these processes 
with slowly varying memory parameter d{t/n) G [0, oo), defined as 



d(i) d(^-^) + l d(*=i±i) - 1 + j 
02,j{t) .- — , J -1,2, 



h2fl{t) ■■= 1, 



2.t 



Y,b2,t-sit)Cs, t = l,. 



,n. 



(5.17) 



Contrary to (5.13), the process in (5.17) satisfies an autoregressive time- varying fractionally integrated 



equation with Q on the right-hand side, see Philippe et al. (2008). In the case when d{T) = d is constant 



function, the coefficients b2j{t) in (5.17) coincide with FARIMA(0, d, 0) coefficients in (5.12) and in 



this case the processes {Xi^t} and {^2,*} in (5.13) and (5.17) coincide 



To see the difference between these two classes, consider the case of step function in (5.14). Then 



X 



i = l,2,, 



ie*n\ 



2,t 



[e*n\ t-l9*n\ 



t-s 



Cs, t = [e*n\ + 1, 



(5.18) 



, n. 



Note 



t-[6>*ri.J 



for t = [9*n\ and monotonically increases with t > [6*n\ . Therefore, (5.18) embodies 



a gradual transition from /(O) to /(I), in contrast to an abrupt change of these regimes in (5.15). The 



distinction between the two models ( |5.15 ) and (5.18) can be clearly seen from the variance behavior: 
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the variance of Xi^t exhibits a jump from 1 to [9*n\ + 1 = 0{n) at time t = [9*n\ + 1, after which it 
hnearly increases with t, while the variance of X2^t changes 'smoothly' with t: 



Var(X2,t) 



1, 



t=l,2,...,[e*n\, 
t= [e*n\ +l,...,n. 



Similar distinctions between (5.13) and (5.17) prevail also in the case of general 'memory function' 



d{-): when the memory parameter d{t/n) changes with t, this change gradually affects the lagged 



ratios in the coefficients b2j{t) in (5.17), and not all lagged ratios simultaneously as in the case of 



bij{t), see (5.12). 



5.4 Asymptotics of change-point statistics for fractionally integrated models with 
changing memory parameter 



In this subsection we study the joint convergence of forward and backward partial sums as in (2.6) for 



the two models in (5.13) and (5.17) with time- varying memory parameter d{t/n). After the statement 



of Proposition 5.3 below, we discuss its implications for the asymptotic power of our tests. 



Let us specify a class of 'memory functions' d{-). For < di < ^2 < oo and < ^ < < 1, introduce 
the class 'Dng{di, d2) of left-continuous nondecreasing functions d{-) = {(i(r),r G [0, 1]} such that 



dir) 



du T£[O,0], 
d2, TG[e,l], 



di < d{T) < d2, 9<T< 



(5.19) 



The interval := [9,0] will be called the memory change interval. Note that for 9 = 6 = 9*, the 
class 'Dq* ^0*{di,d2) consists of a single step function in (5.16). Recall from Section [3] that the interval 



T = [t, r] in memory change statistics in (3.3) and (3.4) is called the (memory) testing interval. When 



discussing the behavior of memory tests under alternatives in (5.13), (5.17) with changing memory 



parameter, the intervals G and T need not coincide since is not known a priori. 
With a given d(-) S Dgg(di,d2), we associate a function 



H{u,v) :-- 




dx, < n < v < 1, 
otherwise 



(5.20) 



Note H{u,v) < since d(x) < d2, x G [0, 1] and H{u,v) = 0ii9<u<v<l. Define two Gaussian 
processes Zi and Z2 by 



Mr) 



V{d. 
1 



{v - ufr 



r(d2) JO 

Z2{r) := 0, re [0,0]. 



^dv]dB{u) = i?S+.5(T)-i?S+.5W, 

^e-^("''')d?;}d5(^/), T>9, 



(5.21) 



The processes {Zi^r), £ [0, 1]}, i = 1,2 are well-defined for any d2 > —0.5 and have a.s. continuous 



trajectories. In the case 9 = 9 = 9* and a step function d{-) in (5.19), Z2{t) for t > 9* can be 
rewritten as 



Z2(t) 



1 



r{d2) Jo 



Ci*\d2 — d 



^dv^ 



dB(u). 



(5.22) 
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Related class of Gaussian processes was discussed in Philippe et al. ( 2008 ) and Surgailis ( 2008 ) . 



Proposition 5.3 Let d{-) G ^(di, ^2) for some < di < d2 < 00, < 9 < 9 < I. Let Si^k CLrid 
S*n-k' ^ ~ -'-'^ forward and backward partial sums processes corresponding to time-varying 

fractional filters {Xi^t}, i = 1,2 in (5.13), (5.17), with memory parameter d{t/n) and standardized 



i.i.d. innovations {Qj, j > 1}. Moreover, in the case di = we assume that E|^ip^^ < 00 for some 
6 >0. Then 

(i) for any 9 € (0,^] with 9>Q 



n 



.5 c* \ 



'D[0,e]xD[0,l-r] ^1,2(^2)), 



1,2, (5.23) 



where 



(5.24) 



and Zi, i = 1,2 are defined in (5.21); 



(a) for any 9 £ [9, 1], for any d > d{9), di < d < d2 



-d-.5 , 



'i, [rtTiJ ) 



n 



-d2 — .5 Q* 



^D[0,e\xD 



[0,1-t] (0,^j,2(T-2)), 



i = 1,2, 



(5.25) 



where Zi^2, i = 1,2 are the same as in 1^5.24]^ . 



The power of our tests depends on whether the testing and the memory change intervals have an 

= r and the asymptotic 



empty intersection or not. When t < 9, Proposition 5.3 (i) applies taking 



distribution of the memory test statistics for models (5.13) and (5.17) follows from Proposition 4.1 
(4.4), with normalization (7n2/7ni)^ = n^('^i~°'2) 



0, implying the consistency of the tests. But this 
situation is untypical for practical applications and hence not very interesting. Even less interesting 
seems the case when a change of memory ends before the start of the testing interval, i.e., when 9 < t. 
Although the last case is not covered by Proposition |5.3[ the limit distribution of the test statistics 
for models (5.13), (5.17) exists with trivial normalization (7n2/7ni)^ = 1 and therefore our tests are 
inconsistent, which is quite natural in this case. 

Let us turn to some more interesting situations, corresponding to the case when the intervals T and 
have a nonempty intersection of positive length. There are two possibilities: 

Case 1: r < ^ < r (a change of memory occurs after the beginning of the testing interval), and 

Case 2: 9<t<9 (a change of memory occurs before the beginning of the testing interval). 

Let us consider Cases 1 and 2 in more detail. 

Case 1. Let T 



[z,ff\ C T. Introduce the following 'dominated' (see (5.27)) statistics: 



WniX) 
Rn{X) 



sup 



n— [nrj 



{X) 



T^f y\nT\{X) 

mf.sr^:-Ln.j(^) 

'ini^^fV\nr\{X) 



In{X) ■-- 



dr, 



(5.26) 



Clearly, 



Wn{X)>Wn{X), In{X)>UX), i?„(X) > i?„(X), a.S. 



(5.27) 
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5.3 



and 
by T and Z\ 



The limit distribution of (5.26) for models (5.13) and (5.17) can be derived from propositions 4.1 
i) choosing d = e_. In particular, it follows that r^^^^'^-^'^WniXi), r?^^^-^^'^In{Xi), and 
t;, i = 1,2 tend, in distribution, to the corresponding limits in (4.4), with T replaced 



1,2 as defined in (5.24). Moreover, it can be shown that 



p oo for any r G T\T. Therefore, in Case 1, the limit distributions of the original 
I the 'dominated' statistics in (5.26) coincide. 

is an inner point of the interval 



statistics in ( |3.3| ) and the 'dominated' statistics in (5.26) coincide 
Case 2. In this case, define T := [r, 0] C T, where G (r, ^ 



[r, 0]. Let Wn{X), In{X), Rn{X) be defined as in (5.26). Obviously, relations (5.27) hold as in the 
previous case. Since the memory parameter increases on the interval T, the limit distribution of the 
process r G T in the denominator of the statistics is not identified from Proposition 



4.1 



we 



(ii). Nevertheless in this case we can use Propositions |4.l| (iii) and 5.3 (ii) to obtain a robust rate of 
growth of the memory statistics in (5.26) and (3.3). Indeed from Proposition 5.3 (ii) with 9 = 
have that n-^^y^^^j (Xj) — ^^^^^-j for any d2 >d > d{9) and hence n'^'-'^-'^^^WniXi), v?id-d2) 
and n^^^~'^''^^ Rn{Xi), i = 1,2 tend to infinity, in probability. 



6 Testing in the presence of linear trend 

The tests discussed in Section [3] can be further developed to include the presence of a linear trend. 
In such a case, partial sums S^^t] may grow as a second-order polynomial of [nrj (see Example 6.1 
below). Then, the null and alternative hypotheses have to be modified, as follows. 

jjtrend. 'pj^gj-g gxists normalizations 7„ — )• oo, A^, Bn, such that 

In^iSlnrl-lnTlAn-lnTl^Bn) ^£,[0,1] Z{t), (6.1) 

where {Z{t),t G [0,1]} is a nondegenerate a.s. continuous random process. 

jjtrcnd. xhere exist < vq < vi < I and normalizations 7„ — )• oo. An, B^, such that 

{ln'{Sinr,\ " L^nJ " [nr\^Bn), Tn^-^fn.,] " M^A^ - [nr2\^*Bn)) (6.2) 



^D[0,?;i]xD[0,l-?;o] 



(0,Z2(r2)), 



where {Z2{t),t G [1 — vi,l — vq]} is a nondegenerate a.s. continuous random process, [nrJ* := 
n - [n(l - r)J = [nrJ , [nrJ 2* — - [n(l - r)J 2. 



Example 6.1 Consider a process {Xt} defined as in Example 2.1 from equation (2.4). We construct 
the process {^t} by adding to {Xt} an additive linear trend: 

Xt = Xt + a + bt, (6.3) 

where a, b are some coefficients. 

When di = d2 = d, we have Xt = et{d) + a + bt and {^t} satisfies the hypothesis Hq''^°'^ with 
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I , An = a + 5 and Z = B^^ ^ . Indeed 



n 



2 

-d-.5 



(5Ln.jW-LnrJ(a+^)-Lnrj2^) 



[nrj 



n 



-d-.5 



S^nri {e{d)) + n-'-'{a[nT\ + 6 J] j - L^rJ (a + -) - [r^rj^-} 



n '^Sinrii^id)) — >D[0,1] -Bd+.5(r), n oo. 



Under linear trend, the test statistics of Section 3.1 have to be modified, as follows. For a fixed 
1 < A; < n, let 

X, := Xj - dkiX) - bk{X)j, l<j<k 

denote the residuals from the least-squares regression of {Xj)i<j<:k on (a + &i)i<j<fc. Similarly, let 

X* := X, - K-kiX) - K_,iX)j, k<j<n 

denote the residuals from the least-squares regression of {Xj)k<j<n on {a+hj)k<j<n- The corresponding 
intercept and slope coefficients are defined through {ak{X), hk{X)) := argmin( X]j=i(^j — o. — 
i^n-ki-X)^ ^n-k(-X)) •~ a'rgmin( Yl]=k+ii-Xj~'^~^^y) ■ '^^^ variance estimates of de-trended forward 
and backward partial sums are defined by 

(6.4) 



K-kix) 



1 



{n - ky 



j=k+i 



(n 



1 ^ \^ 



where 



s, := Y.x, = Y,{x^-^ak{x)-bk{x)i), := ^ = ^(X, - g;„,(x) - 



i=l 



i=l 



1=] 



1=] 



cf. ^A). Replacing Vn{X) ,V*__j.{X) in ([3l3|)-([3^ by the corresponding quantities Vn{X),Vl_f.{X), 

mf.erV:_L„,j(X) 



the statistics in presence of a linear trend are given by 



V* I AX) 
:= sup 7^"^^ , Xn{X) 



V* 

n— [nrJ 



tGT ^[nrj {X) 



dr, Unix) :-- 



mirerVinr] {X) 



(6.5) 



Note that (6.5) agree with (3.3)-(3.4) if no trend is assumed (i.e. b is known and equal to zero). 



Under the null hypothesis Hq^'^"'^ the distributions of (6.5) can be obtained similarly to that of (3.3)- 



(3.4). The following proposition is the analog of the corresponding result (4.2) of Proposition 4.1 

for dell). 



trend 



Proposition 6.1 Under the hypothesis Hq 

(W7^)VL„nj(^)'W7^)K-Ln..jW) ^D(0,1]XD[0,1) {QrAZ),Ql-r,iZ*)), 



where Z* is defined in (3.5) and 



QAZ) :-- 



Z(u, rl^du 



1 r r .0, 1 

T 

Ziu,T) := Z(tx) + 2Z(r)^(l-^ 



+ 6 



Z{u, T)du 
1 



(6.6) 
(6.7) 



T Jo 



Z{v)dv 



u 



u 
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Note that the process {Z{u,t),u G [0,t]} defined in (6.7) satisfies Z{0,t) = Z{t,t) = and 
Jq Z{u,T)du = 0. In the case of Brownian motion Z = B, {Z{u,l),u S [0,1]} is known as the 
second level Brownian bridge (see MacNeill (1978)). Extension of Proposition |3.1| to the modified 
statistics Wn, In, Rn with the ratio (3.2 ) replaced by V*_|^j^^j [X)/V\nT\ {^) is straightforward. Clearly, 



Z{u,t) in (6.7) is different from the corresponding process Z{u) — ^Z{t) in (3.6) and therefore the 
'de-trended' tests >Vn,2I„,7^„ have different critical regions from those in (3.13). We also note that 
{Z(n, r)} can be heuristically defined as the residual process {Z{u^t) = Z{u) — UrU — ^u^} from 
the least squares regression of (dZ(M)/dit)ug[o^r] onto (a + &it)ue[o,r]) with (ar,br) minimizing the 
integral J^i-^^f^ — a — bu)'^du. Indeed, the above minimization problem leads to linear equations 



0, /;( 



dZ(tt) 
du 



Z{t) = aT + b- 



a — hu)udu 
, rZ{T) 



0, or 



Z(u)dn 



r2 



where we used j'^ u du = udZ{u) = tZ{t) — JJ" Z{u)du. Solving the above equations leads to 
the same d,- = — '^Z{t) + ^ /J" Z{u)du, br = ^Z{t) — ^i/T Z{u)du as in (8.18) below. The resulting 



expression of Z{u, r) = Z{u) 



a-rU 



agrees with (6.7). 



7 Simulation study 

In this section we compare from numerical experiments the finite-sample performance of the three test 



statistics in (3.13) for testing Ho[I] against Hi [I] with nominal level a = 5%. A comparison with the 



Kim's tests based on the ratio (1.1), is also provided. 



The main steps to implement the testing procedures defined in (3.13) are the following: 



We choose r = 1 — r for r G (0, 1) which defines the testing region T 
to the choice of r is also explored; 



r,l 



Sensitivity 



For each simulated sample Xi, . . . , Xn, we estimate the parameter d using the NELWE of Abadir 



et al. (2007) as the estimate of d. Following the recommendation in Abadir et al. (2007), the 



bandwidth parameter in the above estimate is chosen to be [\/n\ ; 



The quantiles q^{.05,d) in the critical regions (3.13), as functions of d, for T = W,R,I, and 



for chosen values of r, are approximated by extensive Monte Carlo experiments. The integral 
appearing in the definition of T = / in (3.9 ) is approximated by a Riemann sum. See also Hassler 



and Scheithauer (2008) on approximation of similar quantiles. The quantile graph for T 



and three different values of r is shown in Figure [2| 



7.1 Empirical comparisons of the tests J„, _R„, Wn, In^^i Rn^^i VF, 



yKim 



rKim 
n 



In this section we compare the test procedures based on our statistics I„, Rn, Wn and the corresponding 
Kim's statistics 



j-Kim 



r 



/C„(r)dr, W: 



Kim 



sup/Cn(T) and i?„ 

rer 



MrerU* I AX) 
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Figure 2: The upper 5% quantile of I{B\_^_ 5) as a function of d, for r = .05 (solid graph); r = .1 (sohd 
graph with points); t = .2 (dashed graph). The right plot is a zoom in of the left plot in the region 
d£ [0,.5). 



where /C„(r), Uk{X) and U*_^.{X) are defined in (jTI]) and (jOj). 

The empirical size of the above tests is evaluated by simulating the FARIMA(0,(i,0) process of 
Example 2.1 for d = 0, 0.1, 0.2, 0.3, 0.4. The empirical power is estimated by simulating the FARIMA 
process of Example 2.1, ( |2.4[ ) with of di,d2 G {0, 0.1, 0.2, 0.3, 0.4} and the change-point of d in the 
middle of the sample {9* = 0.5). 

Tables [l] and [2] display the estimated level and power based on 10^ replications of the testing 
procedures, for respective sample sizes n = 500 and n = 5000. These results show that for all six 
statistics and three values of r = 0.05,0.1,0.2, the estimated level is close to the nominal level 5%. 
We also observe that while the performance of the tests /„ and I^*™ does not much depend on r, the 
last property is not shared by W^^"^, Rn^^^ '^n and Rn ■ 

Tables [l] and [2] suggest that when r is small. In clearly outperforms the remaining five tests. As 
T_ increases, the performance of R^ becomes comparable to that of /„, while Wn, In^"^' VF^*™ and 
j^Kim g|.jj| remain less efficient. Clearly, it make sense to choose r as small as possible, since none of 
these tests can detect a change-point that occurs outside the testing interval T = [r, 1 — r] • 

In conclusion, given the choice r = 0.05 (or r = 0.1), the statistic I„ seems preferable to Wn and 
Rn and the three Kim's statistics /i^*™, i?^*"", and VF5*™. 



7.2 Further simulation results pertaining to the test 

As noted above, the results in Subsection 7.1 suggest that I„ is favorable among the six tests in 
the case when the observations follow a 'pure' FARIMA(0,(i,0) model with a possible jump of d for 
d G [0, .5). Here, we explore the performance of /„, when the observations are simulated from other 
classes of processes following the hypotheses Ho[I] and Hi [I]. 

Table [3] extends the results of Tables [T] and [2] to a larger interval of d values, viz., < di < d2 < 1.5. 
Recall that, in accordance with Definition |5.1| (iii), for d > .5 the FARIMA(0, 0) process is defined 
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by 

t 

Xt = Y,Y^^ t = l,...,n, (7.2) 

i=l 

where {Yt} is a stationary FARIMA(0, d - 1, 0). 

Figure [3] shows some trajectories simulated from model (2.4) with fixed d2 — di = 0.3 and three 



different values of di, with the change-point in the middle of the sample. Prom visual inspection 
of these paths, it seems that it is more difficult to detect a change in the memory parameter when 
< di < d2 < .5 or .5 < di < ^2 (top or bottom graphs) than when di < .5 < ^2 (middle graph). Note 
that the top and bottom graphs of Figure [3] correspond to di,d2 belonging to the same 'stationarity 
interval' (either [0, .5) or (.5,1.5)) and the middle graph to di,d2 falling into different 'stationarity 
intervals' [0, .5) and (.5, 1.5). The above visual observation is indeed confirmed in Table [sj The last 
table also shows that when the difference d2 — di is fixed, the test In is more powerful in the region 
< di < d2 < -5 than in .5 < di < ^2- 

Tables |4] and [5] illustrate the performance of /„ when a positive, resp. negative, autoregressive part 



is added to the fractional process {et{di)} [i = 1,2) in the model (2.4). These tables show that 
the performance of the test is essentially preserved, especially when the autoregressive coefficient is 
positive. However in the case of negative autoregressive coefficient the estimated level is slightly more 
disturbed (Table [S]) . Tables [3| [4] and [S] also confirm that In is not very sensitive to the choice of the 
parameter r, i.e. to the length of testing interval. 

Finally, we assess the power of the test for fractionally integrated models with changing memory 
parameters discussed in Section 5^ , Figure |4] presents sample paths of the rapidly changing memory 



model in (5.13) and the gradually changing memory model in (5.17), for the same function d{t/n) = 
.2 + .6 t/n with the middle point t = [n/2j marking the transition from 'stationarity regime' d £ [0, .5) 
to 'nonstationarity regime' d G (.5, 1). The visual impression from Figure|4]is that the above transition 
is much easier to detect for the rapidly changing memory model than for the gradually changing 
memory model. 



Table [6| displays the estimated power of the test for the rapidly changing memory model (5.13) 
when (i(r) = di + {d2 — di)T, = and 6 = 1. The null hypothesis is naturally less often rejected for 
this model than for the model defined in (2.4), cf. Table |3j However, the estimated power still seems 



to be satisfactory. Similar simulations under gradually changing memory model (not included in this 
paper) show that the test has more difficulty to detect this type of changing memory on small samples. 
However, when n is larger than 500, the difference in the estimated power between the gradually and 
rapidly memory cases becomes negligible. 

7.3 Simulations in the presence of linear trend 

In this section we illustrate the performances of the test based on the de-trended statistic In defined in 



(6.5). This testing procedure is implemented similarly to the previous one. Note that the critical region 
still depends on the memory parameter d which is estimated as follows: having observed Xi, . . . ,Xn 
we estimate d using NELWE estimate on the residuals from the least-squares regression of {Xj)i<j<n 
on (a + bj)i<j<n. 



First we apply the de-trended test on series without trend, namely from model (2.4). Table [7| 



displays the estimated level and power of the test for this model. The estimated level is close to the 
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nominal level. Moreover the power is close to that obtained in Table |3| Therefore the performances 
of the testing procedure are preserved even if the estimation of the linear trend was not necessary. 

Second we assess the power of this test in presence of a linear trend (see Table [s]) . Figure [s] presents 
sample paths of models defined in ( |6.3[ ) with a = 1, b = .01, 9* = 1/2, n = 500 and different values 
of di, d2- For this model. Table [8] summarizes the estimated level and power, which are similar to 
Table [3 
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Figure 3: Sample paths simulated from model (2.4) with 9* = 1/2 for different values of di and d2. 
di = .1, d2 = .4 (top); di = .3, ^2 = .6 (middle); di = .8, d2 = l-l (bottom). The sample size is 
n = 1000. 
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Figure 4: Sample paths simulated from models ( 5.13| ) (top) and ( 5.17| ) (bottom) with d(r) = .2 + .6r, 
6* = and ^= 1. 
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Figure 5: Comparison of trajectories simulated from the model (6.3) with a = 1, b = .01, change point 
9* = 1/2 and different values of di and di = .1, ^2 = -4 (top); di = .3, d2 = .6 (middle); di = .8, 
d2 = 1.1 (bottom). The sample size is n = 500. 
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Table 1: Estimated level {di = da) and power {di / ds) (in %) of the tests /„, Wn, Rn, In'"", W^'"", 



j^Kvm^ The nominal level is a = 5%. The samples are simulated from model (2.4) with 6* 
sample size is 500 and the number of independent replications is 10^. 
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1/2. The 
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Table 2: Estimated level {di = da) and power {di / da) (in %) of the tests /„, Wn, Rn, In'"", W^'"", 



j^Kvm^ The nominal level is a = 5%. The samples are simulated from model (2.4) with 6* 
sample size is 5000 and the number of independent replications is 10^. 
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8 Appendix: proofs 



Proof of Proposition 4-1 (i) Without loss of generality, we will assume that Ani = An2 = in what 
follows. Write z„i(r) := T^i^-S^n^j, (n/72 jy^„^j (X) = Yl'i=i Uniir), where the terms 

/[nr J / n 







■ [nr] /n 

Un2{T) := -2(n^/[nrJ^)z„i(r) / ([nnj/[nrj)z„i(u)du, 







!• [nrj / n 

Unsir) := (nVL"rj2)4^(r) / ([nnJ/LnTj)'d^x, 







r-lnri/n ^2 

C/n4(r) := -{n^/[nT\^)i^ I Zni{u)du 



C/n5(r) := 2{n^/[nT\^)zni{T)(^ / z„i / ([nnj/[nrj)du, 



^ JO 

[nrj/n 2 



C/n6(r) := -(nVLnrj3)z2^(r)(y^ ( [nnj / [nrj ) d^.) " 

tend in distribution, as n — t- oo, to the corresponding limit quantities 

C/i(r) := Zf{u)du, 
Jo 

U2{t) := -2t'^Zi{t) [ iu/T)Zi{u)du, 

Jo 

Usir) := T-^Zf{T) [{u/rfdu, 
Jo 

U^t) := -T-'^(^£ Zi{u)du^ , 

C/5(r) := 2T-^Zi{T)(^j\i{u)dv^ j\u/T)du, 

Ue{T) := -T-^Zl{T)i^j\u/T)d^ . 

Note Qr{Zi) = Y!1=i Uiir) a.s. for each r € (0,i;i]. The joint convergence 

(Uniir), C/„6(r)) {Ui{t), . . . , Ueir)) (8.1) 
at each fixed point r S (0, ui] can be easily derived from the (marginal) convergence 'y~iS 



[nrj ^i:>[0,ui] 

Zi(r) in (4.1). The convergence in (8.1) easily extends to the joint convergence at any finite number 



of points < Ti < • • • < Tm, < t^i- In other words, 

(«/7ni)n-j (^) ^mo,v,] QAZi). (8.2) 

In a similar way, 

"fni^lnTl >D[0,l-vo] ■2'2(t), 

implies 

(^/7n2)K-L„.J ^fdd[.o,l) Ql-r{Z2)- (8.3) 

32 



It is clear from the joint convergence in (4.1) that (8.2), (8.3) extend to the joint convergence of 
finite-dimensional distributions, in other words, that (4.2) holds with — >d{o,vi]xD[vo,i) replaced by 



"^fdd(0,Di]x[uo,l)- 

It remains to prove the tightness in D{0, vi]xD[vq, 1). To this end, it suffices to check the tightness of 



the marginal processes in (8.2) and (8.3) in the corresponding Skorokhod spaces D{0, vi] and D[vq, 1). 



See, e.g., Ferger and Vogel (2010), Whitt (1970). 



Let us prove the tightness of the l.h.s. in (8.2) in D{0,vi], or, equivalently, the tightness in D[v,vi], 

n/^'^i)V^nT\{^)- Since {Tn{v),n > 1} is tight by (8.2), it suffices 



for any < v < vi. Let T„(r) : 
to show that for any ei, e2 > there exist 5 > and uq > 1 such that 



P(w5(Tn) > ei) < £2, 



n > no, 



iA) 



where 



ujs{x) := sup { \x{a) — x{b)\ : v < a < b < vi, a — b < 6} 



is the continuity modulus of a function x G D[v,vi]; see Bilhngsley ( |1968[ Theorem 8.2). Since 



'^n{T) = Y2i=i UniiT), it suffices to show (8.4) with Tn replaced by Uni, i = 1, . . . , 6, in other words. 



PiMUni) > ei) < £2, 



n > no, i = 1, . . . ,6. 



We verify (8.5) for i = 2 only since the remaining cases follow similarly. Write Un2{T) = Wt=i Hni[T) 
where i/„i(r) := -2(nVLnrj2) , if„2(r) := z„i(t), i/^sW := fi''^^^'' {[nu\/[nT\)zni(u)du. Then 
P{MUn2) > ei) < EL [P(.0Js{Hm) > ei/(3i^)) +P(njv^ \\Hnj\\ > K)], where ||x|| := sup{|a;(a)| : 
V <a< ui} is the sup-norm. Relation (4.1) implies that the probability P{Ylf=i ll-^nill > ^) 



made arbitrary small for all n > no{K) by a suitable choice of K. By same relation (4.1 ) assumed under 
the uniform topology, for a given ei/K, we have that lims^olimsup^^^F (^uJs{Hni) > ei/K^ = 0. 
This proves (8.5) and the functional convergence {n/^^-^^)V^nT\{^) — ^d{o,di] QriZi). The proof of 
(^/7n2)^ra-|nT| ("'^) — ^D[vo,i) Qi-r('^2) IS analogous. This concludes the proof of part (i), since 



the continuity of the limit process in (4.2) is immediate from continuity of (Zi(ri), Z2(r2)) and the 



definition of Qr in (3.6). 



ii) Note that (4.3) and the a.s. continuity of r i— )• Qr{Zi) guarantees that mfr(:T Qt{Zi) > a.s. 



Therefore relations (4.4) follow from ( |4.2[ ) and the continuous mapping theorem 
(iii) Follows from (4.2) and the fact that Zi{t) = 0, r € T implies Qr{Zi 



0, r e r. 



□ 



Proof of ( 5.4) ■ Let first 



process Xj := Xj — X 



.5 < d < .5 and bi := {a-kTT{d))i — KTTi{d) , i = 0, 1, . . . 

with spectral density /(x) = \d{x) 



EZo biCj- 



Consider the stationary 
- where d(x) = 



We have 



1 := 



-1 and g{x) := (27r)-i|l - e" 



-2d ; 



is the spectral density of FARIMA(0, d, 0). 



E 



X] 



Since d(x) is bounded and continuous on 



f{x)Dl{x)dx 
-7r,7r], a(0) = 



Dnix) :-- 



sin(nx/2) 



sin(a;/2) 
K, it follows that f{x) = 



i.6) 



o(|x|-2rf) (X ^ 0), 



which in turn implies (5.4) for —.5 < d < .5; see e.g. Giraitis et al. (2012, proof of Proposition 3.3.1) 



Next, let .5 < d < 1.5. Then Xj — X- = ^l.^iXk, where the stationary process Xk ■= Yl'^oii'^'^ 



7r{d - - kttM - l))Ck-i satisfies E ^Li ^fe < e{j) ^ 0, {j 



oo 



see above. We 



33 



have 



V 7 = 1 ^ 



n J 



i=l k=l 



ii j2=i 



Jl 



fc=l 



J2 



E(EE^O ^ E ]e(e^O e( 



A:=l 



This completes the proof of (5.4). 



□ 



Proof of Proposition 5.2. Note first that the convergence in (5.6) for type II integrated process of (5.9) 



can be easily established following the proof of Proposition 5.1 Hence, it suffices to show that 



Te[o,i] 



[nrj 

E^? 

t=i 



>P 0, 



where := (1 - - L)iX^ = T.Zo ^-iYl%o'^jid)iTt-j+i{-d) is the contribution arising 

from initial values. When d > 0.5, using ( |5.10 ), the Cauchy-Schwarz inequality and the fact that 
|7rj((i)| < Cj'^^^ we obtain 



E 



n' 



1 " 

iT:5 El^°l 



t=i 



< 



< 



c 



2d+l 



n 



C 



2d+l 



n 



n oo t—l 

EEEk-(^)IK- 

t=l i=0 j=0 
l<j<t<n 



-d)\ 



Since 



E /-'(i-jr'^<Ej''"'E^"' ^ c{ 

l<j<t<n j=l 



k=l 



n'^, d>l, 
nlogn, d = 1, 
n, 



l<d<l. 



This proves (8.7). 



□ 



Proof of Proposition 5.3. We restrict the proof to the case (i) and i = 2, or, equivalently, to the 
model (5.17), since the remaining cases can be treated similarly. Similarly as in the proof of (4.2), it 
suffices to prove the joint convergence of finite-dimensional distributions in (5.23) and the functional 
convergence of marginal processes, viz., 



^D[O,0] 



^2,1 W 



n 



-d2 — .5 



2,lnT\ >D[0,1-t] ^2,2 (t). 



Since X2^t = Yl]=o '^jidi)Ct~j, 1 < i < [^z\ has constant memory parameter di, the proof of the first 
convergence in (8.8) to Z2,i(r) = B^^^ ^(r) is standard, and we omit it. 
Consider the second convergence in (8.8). It can be rewritten as 

n-^'-'S^^lnrl -^D[r,l] ^2(t), (8.9) 

where 5*2^ ^jj,-] = X]i=i^ ^2,t = X]l=i^ Yll=i ^2,t-s{t)Cs- Let us first prove the one-dimensional conver- 
gence in (8.9) at a fixed point r G [r, 1]. 
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We start with the case t > 9. Following the scheme of discrete stochastic integrals in Surgailis 



(2003), rewrite the l.h.s. of (8.9) as a discrete stochastic integral 



Fn{u)dZn{u) 



I Fn{u)dZn{u) + Fn{u)dZn{u), 

Je 



where Zn{u) := n X]«'=i^ Ci is the partial sum process of standardized i.i.d. r.v.s, tending weakly to 
a Brownian motion {B{u),u € [0, 1]}. The integrand Fn in the above integral is equal to 

Fn{u) := n-''^ Yl ht-lnu\it) 

t= [nit J 

'""^^El:iLj^2,t-Ln«j(t), o<u<e, 

^l^^l^^j Trt-[nu\ id2), e <U<T, 
where we used the fact that &2,t-[riuj(^) = ^t-[nuj('^2) for t > [nu\ > [n6\, where 7rj{d) are the 



FARIMA coefficients in (5.12). Similarly, the r.h.s. of ( |8.9[ ) can be written as the sum of two stochastic 
integrals: 



pT rv PT 

I F{u)dB{u) = / F{u)dB{u) + / F{u)dB{u), 
Jo Je 



where 



F{u) :-- 



r(d2)-i J^{v - 'u)'^2-ie-f^("''')d?;, 0<u<e, 

T{d2 + l)-'^{T-uf^, 9<U<T. 



Accordingly, using the above mentioned criterion in Surgailis (2003 Proposition 3.2) (see also 
Lemma 2.1 in Bruzaite and Vaiciulis (2005)), the one-dimensional convergence in (8.9) follows from 
the L^— convergence of the integrands: 



\Fn{u) - F{u)\'^du 0, 



\Fn{u) - F{u)\'^du 0. 



(8.10) 



The second relation in (8.10) is easy using the properties of FARIMA filters. Denote Jn the first 



integral in (8.10). The integrand there can be rewritten as 



Fn{u)-F{u)= [ 

J u 



J2,lnv\-lnu\ 



{[nv\)dv + Gn{u,v)dv - n (nr - [nrj )62 i„^j_i„„j ( [nrj ), 
Je 



(8.11) 

where Gn{u,v) := n^-'^2b2^inv\-lnu\{[nv\) -T{d2)~'^{v - u^^-'^e"^'''''^ and H{u,v) is defined at ( |5.20[ ). 
Let us write 62,l™j_l„„j ([nt^J ) = 7Tinv\-lnu\{d2)Kn{u,v) where 



b2,lnv\-lnu\i[nv\ 



[nv] — [nu] 



n 

i=lV([nt;J-[nej) 



[nv] 



)-l + 



d2-l + i 



We claim that 



lim K„(u,r;) =e-^("'''), 0<n<^<u<l 



.12) 



^.13) 
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Indeed, 



Kn{u,v) 



^ i=ly(\nv\-\ne\) 



where 



i=lV([ni)J-[n0J) 
/ [nv] — [nu] 



(i2 



O 



1 



?1 



H{u,v), 



~i=lV([nv}-[ne}) 



1 



1 V ( [nv\ - [ne\ ] 



Hn{u,v) : 
Rn{u,v) 

hence Rn{u, u) — t- for any v > 6. 

The proof of Jn — in (8.10) then fohows from the foUowing arguments. Using on one hand the 
fact that the ratio Kn{u,v) tends to for < u < v < 6, on the other hand (8.13), and from the 
weh-known asymptotics TTj{d) ~ r{d)^^j'^^^, j — )• oo of FARIMA coefficients, it easily fohows that 
n^~'^^b2^lnvi-[nui{['>T'V\) — ^ for any < u < v < 0, and Gn{u,v) — )• for any < u < v < 1 
fixed. Moreover, the last term in (8.11) obviously tends to because d2 > 0. Since both sides of 



(8.13) are nonnegative and bounded by 1, the above convergences extend to the proof of J„ — )■ by 
the dominated convergence theorem. This proves the convergence of one-dimensional distributions in 



.9) for T>e. 



For T < T < 9, the above convergence follows similarly by using the fact that Kn{u,v) tends to 
for < n < w < ^. 



The proof of the convergence of general finite-dimensional distributions in (8.9), as well as the joint 



convergence of finite-dimensional distributions in (5.23), can be achieved analogously, by using the 



Cramer- Wold device. Finally, the tightness in (8.9) follows by the Kolmorogov criterion (see, e.g. 
Bruzaite and Vaiciulis (2005), proof of Theorem 1.2 for details). Proposition 5.3 is proved. □ 



Proof of Proposition 6. 1 . Consider de-trended observations and their partial sums processes as defined 
by 

k n 

Sj := Xj-{An-Bn)-2Bnj, Sk{e) := ^ej, S*_k{e) := ^ ej. 

j=i j=k+i 

Note that Skie) = Sk{X) - k{An - B^) - k{k + l)Bn = Sk{X) - kAn - k'^Bn and the null hypothesis 
jjtrend rewritten as 



7n'^L-j(^) -^Dm Z{t). (8.14) 
For a fixed 1 < A: < n, let (afc(e), 6fc(e)) := argmin( ^^^-^(ej — 

argmin( — a — bj)'^^ be the corresponding linear regression coefficients. More explicitly. 



dk{e) 



k \ / k 



fc N 2 k 

j=i ' i=i 



(k \ / k \ k 
Ej)(E^.)-^Ei^i 

Ej) -kEP 

j=i ' j=i 
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It is easy to verify that afc(e) = ak{X) + — An), bk{e) = hk{X) — 2i?„. Hence we obtain the 
following expression of residual partial sums Sj = Sj{X) via de-trended partial sums Sj{e) and the 
above regression coefficients: 



hie) 



2 1 



bhie] 



^.16) 



The limit behavior of V[„t-j (X) follows from the limit behavior of S\nu\i'u S [0,t] similarly as in 
the proof of Proposition 4.1 The behavior of the first term 7^^5'|^„„j (e) in (8.16) is given in (8.14). It 
remains to identify the limit regression coefficients a \nT\ (^ ); ^[nrj (s) iii (8.16 ). Clearly the denominator 



12- 



The numerators in (8.15) are written in terms of Sk{e) and Ylj=ij^j- 



From summation by parts and (8.14) we obtain 



[nTj 



[nrJ-1 



n 



'Sn^y^jej = SnM L^'rJ5'Lnrj(e) - Sj{e)) — >d[o,i] tZ{t)- ( Z 



{v)dvi%.l7) 



Relations ( |8.14[ ), ( |8.15[ ) and ( |8.17[ ) entail ( [nnj /7„)aL„^j (e) ->d[o,t] ^i«r, /(27n))ft[nrj(e) -^D[o,r] 

li^^, where 



2 - Z(t)+6 



1\2 



Z{v)dv, br := 6(^^)^Z(r) - 12 



Jo 



Z{v)dv, (8.18) 



leading to the convergence Jn^^lnu] — ^d[o,t] Z{'U',t), where the limit process is given in (6.7). The 
remaining details of the proof are similar as in Proposition 4.1 □ 
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